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Abstract 

The flavor-changing top-quark decay t — > c/i, where h is the hghtest CP-even 
Higgs boson in the minimal supersymmetric standard model, is examined in 
the R-parity-violating supersymmetric model. Within the existing bounds on 
the relevant R-parity-violating couplings, the branching fraction for t — > c/i 
can be as large as about 10~^ in some part of the parameter space. 
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Typeset using REVT^ 



The study of heavy-particle decays via flavor- changing neutral-currents (FCNC) has 
been playing an important role in testing the standard model (SM) and probing new physics 
beyond the SM. As the heaviest elementary particle in the SM with a mass at the electroweak 
scale, the top quark is more likely to be sensitive to new physics. Kinematically it is accessible 
to many FCNC decay modes, such as t ^ cV {V = 7, Z, g) and t — > c/i, where /i is a Higgs 
boson. In the SM these FCNC decay modes are highly suppressed by GIM mechanism, with 
branching fractions typically of 10~^^ — 10~^° IHIH) which are too small to be detectable at 
collider experiments. On the other hand, observation of any of such FCNC top-quark decays 
would be robust evidence for new physics 0-0. 

Top quarks will be copiously produced at the next generation of hadron colliders. At the 
upgraded Fermilab Tevatron with an integrated luminosity of 10 fb~^, there will be about 
8 X 10^ top quarks produced, while there will be about 100 times more at the LHC with 
the same luminosity. With such large data samples, good sensitivities may be reached for 
searching for the rare decay channels t cV and for studying other related processes 
at hadron colliders A more recent study showed that the channel t ^ ch could also be 
detectable 0, reaching a sensitivity level for the branching fraction Br{t —>■ ch) ~ 5 x 10^^ at 
the LHC and a few percent at the Tevatron. While these high detection sensitivities are still 
far above the SM expectation for the rare decay channels , in many scenarios beyond the 
SM the branching fractions of these FCNC top-quark decays could be significantly enhanced 

EHl. 



In the minimal supersymmetric (SUSY) standard model (MSSM) |T2| with R-parity 
conservation, it was shown that the possibility for observing the decay channel t ^ ch 
could be greatly enhanced (here h is the lightest CP-even Higgs boson). Kinematically this 
decay mode is always allowed because of the strict theoretical upper bound on the Higgs 
boson mass |TB[ , and the decay receives dominant contributions from the SUSY QCD loops 



of fiavor-changing interactions P). If the gluino and squarks involved in the contributing 
SUSY QCD loops are both light of order 100 GeV, the branching fraction could be enhanced 
to a level of 10~^. The branching fraction falls off quickly for heavier sparticles in the loops. 

In this Letter we examine the R-parity- violating contributions to t — *■ ch. It is well-known 
that the R-parity conservation in SUSY theory, which implies the separate conservation of 
baryon number and lepton number, is put in by hand. R-parity violation (^) can be made 
perfectly consistent with other fundamental principles such as gauge invariance, supersym- 
metry and renormalizability |T^. If R-parity violation is included in the MSSM, t ^ ch 
will receive new contributions from the loops of R-parity-violating interactions. Such con- 
tributions can be significant for the following reasons. First, such contributing loops only 
involve a single sparticle, i. e., a squark or a slepton. The mass suppression in the loops 
thus becomes less severe than that in the MSSM. Second, the relevant |2 couplings inducing 
t ^ ch involve the third-generation fermions and are subject to rather weak bounds from 
low-energy experiments. We find that the branching fraction for t —>■ ch from ^ contribu- 
tions can be indeed as high as about 10~^ in some part of the parameter space, reaching a 
level of potentially accessible at the LHC with a high luminosity. 

We start our study by writing down the ^ superpotential of the MSSM 

= lk,kL.L,E^, + K.kUQjDl + ^X'l^.U'rD'^pi + (1) 
where Li{Qi) and Ei{Ui,Di) are the left-handed lepton (quark) doublet and right-handed 
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FIG. 1. Feynman diagrams oit^ch induced by ^ SUSY interactions. 



lepton (quark) singlet chiral superfields. i^j^k are generation indices and c denotes charge 
conjugation. Note that SU{2)l and SU{^)c indices have been suppressed. Hi^2 are the 
Higgs-doublets chiral superfields. The \ijk and A^^^ are the lepton-number-violating (^) cou- 



plings, and Afj-j. the baryon-number-violating (^) couplings. Constraints on these couplings 
have been obtained from various low-energy processes [|T5H 2l|| and their phenomenology at 
hadron and lepton colliders have been intensively investigated recently pl| , |22[] . Note that 
although it is theoretically possible to have both ^ and ^ interactions, the non-observation 
of proton decay prohibits their simultaneous presence, at least in the first two fermion gen- 
erations. We therefore assume the existence of either // couplings or couplings, and 
investigate their separate effects in top-quark decay t —>■ ch. 

We focus our attention only on the tri-linear supersymmetric |? interactions in Eq. (|l]) 
and assume that the bi-linear terms HiLiH2 can be rotated away by a field redefinition . 
In this case the FCNC decay t ch is induced by only the tri-linear ^ interactions via loops. 
Note that, in principle, there are also possible ^ terms in the soft-breaking part [^. In that 



case, it is no longer possible in general to rotate away the bi-linear terms |23,24| and such 
bi-linear terms will cause the mixing between the neutral Higgs bosons and the sneutrinos 
(u). As studied in |]10[, the FCNC decay t ^ cu can be induced by the one-loop diagrams 
of the tri-linear couplings. Followed by the oscillation v ^ h induced by the bi-linear fi 
terms, one can also have t ci) ^ ch, which, however, is only appreciable when h and z> 
are nearly degenerate. We will not consider this possibility further. 

In terms of the four-component Dirac notation, the Lagrangian of the ^ couplings A' and 
^ couplings A" are given by 



= -A' 



ijk 



V. 



"^Ldn^^L 



(d'n 



+ h.c, 
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dU^'nyd^R + dUd^nTu^R + u'R^d'^ 



+ h.c. 



(2) 
(3) 



With ^ couplings, the decay t ^ ch can proceed through the loop diagrams shown in Fig. 1, 
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FIG. 2. Feynman diagrams of t ^ ch induced by ^ SUSY interactions. 

where a down-type quark and a squark are involved in the loops. If the lepton number is 
violated instead, the decay i — > c/i can occur through the diagrams in Fig. 2, where a down- 
type quark and a slepton (or a down-type squark and a charged lepton) are in the loops. 
We note that in the former case the products of ^ couplings y2jk^3jk ^-i"® involved while in 
the latter case the products of ^ couplings X'j^2kK3k involved. 



The induced effective tch vertex is given by, in the cases of ^ and ^ respectively. 



(4) 
(5) 



where = (^c ~ 1)' = 2 is the color factor and Pr^l = i(l ± 75). The factors F^ji from 
the contributions of Fig. 1 are given by 



Ff = Y^mtm^ (Co + 2Cii){-pf,Pc, , m^k , m^) 
-FYjfc mt(Cii - C12) (-pt, k, , mj^ , m^k) 

R 

n2 



-Yr— nBi[pt, rrijj , m^k) - Yf 



mi 



(6) 



-pR = -Y^mcrridj (Co + 2Ci2){-pt,Pc, md3,m^k,m^) 



-Y, 



c 2 9 
— 



(7) 



The factors Ff^^ = + where pf^uid) and Fi„r{^) are respectively the contri- 

butions of Fig. 2 by exchanging squarks d'^ and sleptons e', are obtained by the substitutions 



FfAd) = Ft, 
FiAe) = Ft, 



L 



d;i-*d'',d'l^-^e'l,mjj-*-m^k ' 
4 



(8) 
(9) 



TABLE I. Current 2cr bounds on X'L;^, X'^^k and 



i3A; ' 



couplings 



bounds 



sources 



X' \' \' 

^121) ^^122' ^123 



221 

\> \' \l 
^3211 ^322' ^^323 



A'i 



131 



132 
\/ 

^^133 
\' 

^^231 



A'o 



232 
\' 

^233 

\' \l \l 

-^331' ^332' ^^333 

^212) ^^213' '^223 
^312) ^^313 5 '^323 



0.043 X (mj^/100 GeV) 
0.18 X (mj^/100 GeV) 
0.21 X (mj^/100 GeV) 
0.52 X (mj^/100 GeV) 
0.019 X (m^-^/lOO GeV) 
0.28 X (mj^/lOO GeV) 
0.0014 



'm-JWO GeV 
0.18 X (m^^/100 GeV) 
0.56 

0.15 X ^m-JlOO GeV 

0.45 

1.23 

1.0 



charged current universality [1 



deep inelastic scattering |15,16| 



D-meson decay |1 



Dg decay |16[ , 

atomic parity violation |T^,17[ 
asymmetry in e^e~ collision |15] 
neutrino mass |]l8| 

deep inelastic scattering |15,16| 



Z decays [19 
neutrino mass [|l8| 
Z decays [19 
perturbativity [|2 
Z decays [19 



In the above expressions the sum over family indices i,j,k = 1,2,3 is imphed. pt, Pc and 
k are the momenta of the top quark, charm quark and Higgs boson, respectively. The 
functions Bi and Cij are the conventional 2- and 3-point Feynman integrals [^S], and their 
functional arguments are indicated in the bracket following them. The constants like Y^j are 
the Yukawa couplings of the corresponding particles given by 

= ^ "^7° ^ , (10) 
2mw sm &w cos p 
^ _ ruu cos a 

" 2mw sin 9w sin /? ' 

1 7Tz3 sin cx 

Yd^ = --mztanewsmia + (3) + ^ -, (12) 

^ 3 niw sm 9iv cos p 

""^^ A . 2 /, X . / ^^ sina 
cos Uw sm Uw 2 mw sm Uw cos p 

where 9w is the weak mixing angle, a the neutral Higgs boson mixing angle, and tan/3 = 
V2IV1 the ratio of the two vacuum expectation values in the Higgs sector [|l^. 

The ultraviolet divergences are contained in the Feynman integral Bi. It is easy to check 
that all the ultraviolet divergences cancel as a result of renormalizability of MSSM. 

As a good approximation of negelecting all the fermion masses but rrit, the expression 
can be substantially simplified. The only contributing diagram in this approximation is that 
of the Higgs boson coupled to the sfermion. The partial decay width is then given by a 
simple form 



T{t ch) = ^ 



(Cii - Ci2){-pt, k, 0, mj, mj) 



167r2 



(14) 



where 
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K 



for ^ 
for ^. 



This expression is accurate at a level of a few percent. 

Now we present the numerical results for Br{t ch) with the full expression. For the 
SM parameters involved, we take rrit = 175 GeV, mz = 91.187 GeV, mw = 80.3 GeV, 
a = 1/128, sin^^vK = 0.232, = 1.7 GeV, nib = 4.7 GeV, and m, = 0.17 GeV. The 
results are not sensitive to the light fermion masses. The SUSY parameters involved are the 
following: 

(1) ^ couplings X2jk and Ag^^, and couplings A^g^ and X'^^/.: The current bounds for all 
^ couplings are summarized in Ref. 0]. In Table 1 we only list those relevant to our 
study. We note that the current bounds for the ^ couplings are generally quite weak. 

(2) Slepton and down-type squark masses: The off-diagonal terms in the sfermion-mass 
matrices are proportional to the mass of the corresponding fermion, and they are thus 
relatively small for the down-type squarks and sleptons. Only for large tan/3, the 
mass splitting of the sbottoms (staus) becomes sizeable. Nevertheless, the inclusion of 
the mass splittings for sbottom (stau) does not affect our results appreciably. In our 
numerical illustration, we thus assume a common mass for all squarks (sleptons). 

(3) Higgs masses and mixing angles of the Higgs sector: At tree level the Higgs sector 
of the MSSM is determined by two free parameters, e. g., the CP-odd Higgs boson 
mass ttla and tan f3. When radiative corrections are included, several other parameters 
enter through the loops |jl3|]. In phenomenological analysis it is usually to assume a 
common squark mass scale rriq and thus the dominant one-loop corrections can be 



parameterized by a single parameter e [2^ 



87r2 



m 



-m^ In 



1 + 



(15) 



w 



Then the Higgs masses and mixing angle a are obtained by 
1 



tan 2a 



m^ + m^ + e/ sin (3 



±- 



1 



m\ — m%) cos 2/3 + e/ sin^ j3 + (rn\ + sin^ 2(3 
m\ + m|) sin 2(3 



1/2 



{m\ — m|) cos 2(3 + e/ sin^ (3 



(16) 
(17) 



In our calculation we adopt the standard convention [|T3,^, in which — 7r/2 < a < 
and < < 7r/2 so that as itla — > oo, we have a ^ (3 — 7r/2 and thus the h cou- 
plings approach to those of the SM Higgs boson while other Higgs bosons {A, H, H"^) 
decouple. 

The current constraints on the parameter space of the Higgs sector were given by 
the LEP experiments ||2^. The region of small tan/3 and low Higgs mass has 
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FIG. 3. Br{t ch) versus squark mass for tua = 300 GeV and tan/? = 10. The solid and 
dashed curves correspond to B- violation and L-violation, respectively. 

been excluded, depending on the extent of top-squark mixing. In any case the robust 
bounds ruh > 83.4 GeV and > 83.8 GeV have been obtained at 95% confidence 
level for tan/? greater than 0.8. 

The decay rate increases quadratically with the relevant A' or A" couplings and decreases 
with the increase of the sparticle mass. Using the upper limits of the relevant ^ couplings 
in Table 1, we present the maximum values of the branching fraction in Figs. 3 — 5. 

Fig. 3 shows the dependence of Br{t ch) on squark mass for = 300 GeV and 
tan/? = 10. The solid and dashed curves correspond to B- violation and L-violation, re- 
spectively. With the parameter values in this figure, the value of rrih is within the range 
93 ~ 106 GeV corresponding to the squark mass range 100 ~ 300 GeV. The results manifest 
the decoupling property of the MSSM, i. e., the contributions drop with the increase of 
the squark mass. We found that when squarks become sufficiently heavy {> 500 GeV), 
they decouple quickly and the branching fraction goes down like l/ml asymptotically. From 
Fig. 3 one sees that in the ^ case, for a squark as light as 100 GeV, the branching fraction 
can reach the level of 10~^. In the ^ case, however, the contributions are below the level of 
10~^ because of the current stringent bounds on the relevant couplings in Table 1. Thus in 
the following we do not present the ^ contributions any more. 

Fig. 4 shows the p contributions to Br{t — > ch) as a function of tan/3 for = 300 
GeV. The solid and dashed curves correspond to squark mass of 100 GeV and 200 GeV, 
respectively. The hatched region is excluded by LEP experiments |]2^ . Note that in the case 
of maximal top-squark mixing, the very small tan/? region (< 0.2) is still allowed by LEP 
experiments and in this region the branching fraction can also be significant. Regarding nih, 
in the small tan/3 range 0.01 < tan/3 < 0.2, we have 91 < m,, < 92 GeV (91 < mh < 93) 
for squark mass of 100 GeV (200 GeV). In the large tan/3 range 4 < tan/3 < 100, we 
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FIG. 4. ^ contributions to Br{t — > ch) versus tan/3 for = 300 GeV. The solid and dashed 
curves correspond to squark mass of 100 GeV and 200 GeV, respectively. The hatched region is 
excluded by LEP experiments. 

have 84 < m,, < 94 GeV (91 < nih < 101 GeV) for squark mass of 100 GeV (200 GeV), 
corresp ondingly. 

Fig. 5 is the p contribution to Br{t —>■ ch) versus rriA for tan/3 = 10. The soUd and 
dashed curves correspond to squark mass of 100 GeV and 200 GeV, respectively. The range 
of mh is 83 < m,, < 93 GeV and 85 < m;, < 100 GeV for squark mass of 100 GeV, 200 
GeV, respectively. This figure shows that the dependence of the branching fraction on tua 
is quite mild. 

A couple of remarks are in order regarding the above results: 

(1) The branching fraction is very sensitive to the relevant ^ couplings, e. g., in the ^ case, 

is proportional to (^^2jk'^3jk) ■ The relaxation of some bounds in Table 1 will result 
in large enhancement of the branching fraction. For example, so far no experimental 
bound for Xi^jj^ has been reported and we used the theoretical perturbativity bound 
(~ 1.23) |2^. Such a bound is derived from the assumption that the gauge groups 
unify at Mjj = 2 x 10^^ GeV and the Yukawa couplings Yt, Yf, and Y^- remain in the 
perturbative domain in the whole range up to M^, i. e., Yi{jj) < 1 for /z < 2 x 10^^ 
GeV. But there is no a priori reason to take this theoretical assumption. So the bound 
on A'ajfc could be even weaker. 

(2) The decay rate is proportional to a product of two ^ couplings, and thus the non-zero 
decay requires the coexistence of at least two couphngs. Although we do not expect any 
stringent constraints on the coupling products involving the third-generation fermions, 
it would be interesting to seek for other possible FCNC processes at low energies which 
may be induced by such coexistence of more than one ^ coupling. 
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FIG. 5. ^ contributions to Br{t ch) versus for tan/3 = 10. The solid and dashed curves 
correspond to squark mass of 100 GeV and 200 GeV, respectively. 

(3) We assumed a common mass for all squarks or sleptons for illustration of the numerical 
results. Our results are not very sensitive to the mass differences of the sfermions 
because the involved couphngs, A" or A', are not unitary in general so that the 
delicate cancellations (like the GIM mechanism) do not generally occur. 

(4) Although in our analysis we varied tan/5 freely and only considered the direct LEP 
constraints, we note that the extreme case of a very small or very large tan jS value 
may be severely disfavored by some theoretical arguments and/or by some indirect 



experimental constraints like those from b ^ S'j ||29|. Since the branching ratio of 
t ^ ch could be significantly enhanced also in the intermediate range of tan/3 (say 
4 < tan/3 < 30), our conclusion will not be affected by such indirect experimental 
constraints. 

(5) Finally, we point out that we only presented the analysis for the most interesting decay 
channel t ^ ch because kinematically it is always allowed. Other decay channels, t — *• 
cH or t — > cA, are quite likely to be suppressed by phase space or even kinematically 
forbidden. If the channel t — > is kinematically allowed, the branching ratio Br{t — »• 
cA) can also be significant for a very large tan P (> 40) because its coupling to bottom 
quark is proportional to tan /?. Since its coupling to top quark is proportional to 
cot f3, Br{t — >■ cA) could be enhanced significantly for a small tan/3. However, for 
such a light Higgs boson A (m^ < 175 GeV), the small tan/3 region has been almost 
completely excluded by LEP experiments [^]. 

In summary, we found that the FCNC decay t ^ ch can be significantly enhanced 
relative to that of the SM in SUSY theories with R-parity violation. The branching fraction 
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depends quadratically upon the products of fi couplings, and scales with the heavy mass 
of the sfermions in the loops as ^J^, and it can be at least as large as that in the MSSM. 
In the optimistic scenario that the involved couplings take their current upper bounds and 
~ 100 GeV, the branching fraction can be as large as 10^^, which is potentially accessible 
at the LHC with a high luminosity. 
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